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ABSTRACT 

Future space robots require position and orien- 
tation tracking with visual feedback control to track 
and capture floating objects and satellites. We de- 
veloped a four-circle mark that is useful for this pur- 
pose. With this mark, four geometric center posi- 
tions as feature points can be extracted from the 
mark by simple image processing. We also devel- 
oped a position and orientation measurement 
method that uses the four feature points in our marie. 
The mark gave good enough image measurement 
accuracy to let space robots approach and contact 
objects. A visual feedback control system using this 
mark enabled a robot arm to track a target object 
accurately. The control system was able to tolerate a 
time delay of 2 seconds. 

INTRODUCTION 

The National Space Development Agency of Ja- 
pan (NASDA) plans to conduct a series of space 
robot experiments on Engineering Test Satellite 7 
(ETS-7)[1][2] scheduled to be launched in 1997. 
All experiments will study the feasibility of basic, 
rather than advanced, functions of the space robot. 
Technology for tracking objects using visual feed- 
back control is essential to implementing tracking 
and capturing floating objects and satellites. The 
first step is to develop a technology that enables a 
robot arm to track a mark. 

Our four-circle mark has four circles in a square. 
The position and orientation of the mark can be cal- 
culated by solving a perspective n-point problem 
from the four feature points extracted from the four 
circles by simple image processing. The robot arm 
tracked die mark using the results of mark position 
and orientation measurements. 


PROBLEMS ADDRESSED BY THE MARK 
TRACKING EXPERIMENT 

A visual feedback control system for a robot to 
track a mark must work in real-time. Onboard com- 
puters, however, have limited capacities, and are 
too slow to handle a large volume of image data. 
Processing and measuring the images of the mark 
being tracked require the following: 

(a) A mark that allows feature points to be extracted 
by simple image processing. 

(b) A measurement technique that does not require a 
high computer load to calculate position and ori- 
entation using extracted feature points. 

A visual feedback control system also needs a 
control algorithm that involves less load on the 
onboard computer. 

MEASUREMENT 

Position and Orientation Measurement using 
the Four-Circle Mark 

Generally, in a Perspective N-point problem 
(PnP) [3-5], if three or more feature points extracted 
from an image, the position and orientation of the 
mark can be determined from the positional rela- 
tionships between these feature points and their cor- 
responding points in the image. Our measurement 
determines the position and orientation of the mark 
from four feature points in the same plane with 
known positional relationships and their corre- 
sponding points in the image. This has the advan- 
tages of fewer feature points of interest, a unique 
solution, and lower calculation load. 

Figure 1 shows the position and orientation mea- 
surement using the four feature points. The transfor- 
mation matrix T, which represents translation and 
rotation, denotes the position and orientations of the 
mark [6]. Vectors a , (3 and y , A, B, and C, and 0 
and O' are related to each other by a matrix that is 
represented by the product of the transformation 
matrix T and the perspective transformation matrix 
P. The six linear equations derived from these rela- 
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(Figure 2). The geometric center positions of the Fig. 2 Four-circle mark 

four circles are associated with four feature points. 

The position in the image that corresponds to each mark and the corresponding points in the image, 
feature point can be determined by calculating the 

weighted mean from the vertical and horizontal pro- TRACKING ALGORITHM 
jection deviations of the circle. This results in an im- 
aging accuracy of one subpixel. One of the four The robot arm is controlled in the mark tracking 
circles is made larger than the others to define the experiment by the basic control system shown in 

correspondence between the feature points in the Figure 3. This proportional plus derivative (PD) 
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marie and the corresponding points in the image. 

TRACKING ALGORITHM 

The robot arm is controlled in the mark tracking 
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4 -circle mark 


the joint coordinate system as a joint angle velocity 
command. The joint angle velocity command is fed 
back to the robot controller as a velocity command. 

EXPERIMENTS 

Experimental System Setup 

Figure 4 shows the Experimental System Setup. 
The robot arm has the same six degrees of freedom 
as the orbiting arm on the ETS-7. The arm is ma- 
nipulated by inputting joint angle velocity com- 
mands to the robot controller. For mark movement, 
an XYZ- 8 stage capable of moving the mark with 
four degrees of freedom was used to simulate the 
behavior of a slow spinning satellite. 
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Experiment Results and Discussions 


Fig. 4 Experimental system setup 


Figure 5 shows the measurement accuracy with 
respect to the distance to the mark. The mark has a 
circle-to-circle distance of 100 mm. Translation er- 
rors are less than 5 mm up to the distance of 700 mm 
in the x and y axis directions, and less than 2 % of the 
distance in the z axis direction. Orientation errors 
are less than 2 degrees in the roll, pitch, and yaw 
rotations. These errors are sufficient for the robot 
arm, which has force control to approach an object 
of interest. 

Figure 6 shows the measurement accuracy at a 
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distance of 500 mm when the mark rotates around y 
axis (pitch angle). Accuracy drops as the pitch angle 
increases. At a pitch angle of 20 degrees, measure- 
ment errors are about 2% of the measurement dis- 
tance in the x,y, and z directions, and about 2 de- 
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Fig. 7 Target locus and tracking locus in the X-Y plane 
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Fig. S Errors in position and orientation measurement with respect to the distance 
(Circle-to-circle distance: 100 mm) 



Fig. 6 Errors in position and orientation measurement with respect to the orientation 
(Circle-to-circle distance: 100 mm) 



Fig. 8 Time response of the target locus and 
tracking locus in the Y -axis direction 
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CONCLUSIONS 



Fig. 9 Tracking gain and phase by time delay 
mark velocity: 60 s/cycle 

With a time delay of 8 seconds, tracking fails and the 
mark moves outside the image 

grees in orientation angle. This loss of accuracy is 
caused by distortion of the circles in the image 
plane, if the pitch angle is large. Accuracy at an ori- 
entation angle around 0 degrees is sufficient for the 
robot arm to approach the mark perpendicularly. 

Based on our findings, we conducted a four- 
circle mark tracking experiment by simulating the 
behavior of a slow spinning satellite as a target for 
tracking and capturing. The slow spinning satellite 
has the mark on its tip. As the mark moves, it draws 
a circular locus with a diameter of 100 mm. With a 
circle-to-circle distance of 50 mm, the mark travels 
in a circular locus at a rate of 60 seconds per rota- 
tion. Figure 7 shows the target locus and the track- 
ing locus in the X- Y plane with respect to the behav- 
ior of the mark at a distance of 500 mm. Figure 8 
shows the tracking locus in the Y direction. The re- 
sults show that the robot arm tracked the locus of the 
mark accurately, with a phase delay of about 5 de- 
grees. The sampling time from image processing to 
computing the joint angle velocity was about 0.2 s 
at a distance of 500 mm. These performances en- 
able the robot arm to track and capture floating ob- 
jects. 

Figure 9 shows tracking gain and phase delay as 
time delay increases. The robot arm could track the 
target locus accurately with time delays up to 2 sec- 
onds, and the phase delay was about 20 degrees. 


We developed a real-time position and orienta- 
tion measurement method that uses a four-circle 
mark. These simple image processing and measure- 
ment algorithms will be used in orbit. 

The measurement method was accurate enough 
to enable the space robot to approach an object of 
interest. 

We built a visual feedback control system using 
the four-circle mark and conducted mark tracking 
experiments. The robot arm tracked the locus of the 
mark with a phase delay of about 5 degrees with 
respect to the locus of the mark. Accuracy was 
therefore good enough to track and capture objects. 

We also performed a mark tracking experiment 
that used tracking data with a time delay to simulate 
teleoperation from the ground. The robot arm 
tracked the target locus accurately with phase de- 
lays for time delays of up to 2 seconds. Further- 
more, predictive tracking control will be effective in 
tracking objects accurately when the tracking data 
has large time delay. 
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